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(57) Abstract: 

FIELD: video equipment. SUBSTANCE: 
decoder provides base channel and extension 
channel and has frame loss detector for 
detection of ceil frame from extension. In 
this case extension data of previous video 
signal which are shifted by shifter 
according current movement vectors are used 
as data for interpolation of last frames, 
interpolation data are added to decoded base 
channel according to adder, Extension data 
are produced by subtraction of previous base 
video signal which is stored in memory unit 
from previous decoded video signal which is 
stored in memory unit according to 
subtracter. EFFECT: increased image quality 
6 ci, 5 dwg 



O 
O 

o 


-2- 



RU 2 120 702 0/ €1 
)MriKS H 04 N 7/24 


T > On^lCAH^E M3QGPETEHMfl K nATEHTY POCCI/lflCKOfl 0EflEPAL|HH 


(21). (22)3anBKa: 93051542/09, 31.01.1992 

(30) npnopMTST: 01.02.1991 GB 910 2220.2 

(46) flara nyS.nwKaun*: 20.10.1998 

(56} Ccbi.mw: 1 . US, naTBHT 4933762 A, kit H 04 N 
7/13. 1990. 2. EP, narenT 03S7402, xn. H 04 
N 7/13, 1990. 3. PR, rrarsHT 2526620, ten. H 
04 N 7/13, 1983. 


(72) l-lsoSperaTarib: Moxsmmba MaH6apn (IR) 
KownaHM (GB; 


(54) CPOCOB flEKOflMPOBAHMfl OflHOro nOJlYMEHHOrO <V:|.fTO CKmATIA M3 CEPMM 
flBYXKAHAJlbHUX KOflHPOBAHHblX BMflEOCHrHAJlOB H yCTPOflCTBO flJIfl Ef"G OCyiUECTBJlEHHH 

(57; Petpepa? 

/.Vii'O.asf, /ins As-ii'.-o^i-ipoe.Sfi/^ :CO,3.;-:poRSHH!>x 
ift£ ys.u am >ctohu. mi via Da; 
Kanaka paciiiHpeHUfl, BicnicwaeT fieTekrop 

i i Lii e hi 3l.ii w-eeK K3 

KaHana paounpsHnn. B TaKOM cnynae aas-iiHbie 
paouLiMpeHns i« HenocpeflCTBeHHO 
npeAiiisc5TByK5U4©ro BHfl90cnrHana, cweinenHbie 
BbirecHMTeiieM comacHO TsuyunMM BeicropaM 
ABfi^ei-ififi, npeflcraanfitoT aannbie 

. r i , / j epwn x si-H sic flaHHbie 
i/iHTepnojiflL^w npHoaBjnatoTGq k 

> f Is , |.1f 38 JHHC f in I iH 

jywvaTOf 3M Ran i&ie paci tupe if noryMaiOTCP 
nyreM BbwuTaww HenocpefldBeHHO 
ipo/,E u;i!».!u: , ' ' -I ■ ■ vi 

J '..-1 -i 3 I !E ^ /, HI > 3'CTB? '0 

- ■> , ' o I ' IE I'-rr, 

I ' I J o^li 

8 3anOMMH3K>U;» M 5 ^ 3 




€1 


H ©4 N 7/24 


< 12 > ABSTRACT OF INVENTION 


(21), (22) Application: 93051542/09, 31 01 1992 

(71) 

Applicant: 



British Telekomm'iunikejshnz Pablik Limited 

(30) Priority: 01.02.1991 G3 910 2220.2 


Kompani (GB) 

(46) Date of publication: 20.10.1998 

(72) 

Inventor: Mokhammed Chanbari (IR) 


(73) 

Proprietor: 



British Telekomm'junikejshnz Pabiik Limited 



Kompani (GB; 


7i 
c 


(57) Abstract: 

FIELD: video equipment. SUBSTANCE: 
decoder provides base channel and extension 
channel and has frame loss detector for 
detection of ceil frame from extension. In 
this case extension data of previous video 
signal which are shifted by shifter 
according current movement vectors are used 
as data for interpolation of last frames, 
interpolation data are added to decoded base 
channel according to adder, Extension data 
are produced by subtraction of previous base 
video signal which is stored in memory unit 
from previous decoded video signal which is 
stored in memory unit according to 
subtracter. EFFECT: increased image quality 
6 ci, 5 dwg 



O 
O 

o 


-2- 


7J 


HacrofiLyee nso6peTeHH£ 

BMfieocurHana, nony^eHHoro na TeKyLU,ero 
noTOKa flEyxKaHa.nbHbix saKOAi-ipoBa.HHbix 
anfiecjcurnajioB, KajKflbiB t« Koropbix BKnie>-iaeT 
Kanar Sasbi aaKOAwposaHHbix aaHHUX xaHana 
6aabi m saKO/i.npoisaHHbie aawnbis Betxropa 
AB*>KeHKfl KaHajia pacLunpeHH>i 

; j 3 j 3 i j ' i 

npefiCTaej^iKLniix coooii pasnocTb Me.^iiy 
i ' / 

3 i [ ft - 

] ! > i I 3 

Kanaka 6a3bi. 

B flanHQM fipuweHennn BUfieocwmanbi 

OppaSb! CCOTHOCflTCf! K Li/lCppOEOMy 
■'1 PSPCT?; Kf'ab ft, 8 ;1 .- ; eoi'!C': ;>IH M Ka 

TaKoe Tan: nasbisaeMoe ^yxKaHanbHoe 

0B3W Bi-ppeC H3.nGE ObiTK 

if rpi-icss abeao ;..r . b-cnoTb.-ac janut £ ' KMiw 
roprosbiv: aBTOMaroB {A'tMj cyeivibi Mor.nn 
I - i ttopfsi Moma craTb 

' , iHofi 3HaMMTeribHoro pa3pbiea a noTOKax 
Ran 

nepe/ia'W 6ht (VBR). 

I , ' 3 t Ml 

KOfltfpcBaHWfl cnncaH b nareHTe CLLIA N A 
&oo7'^.i i noi >:.:. i :: ■,c , p " : "v : i ; '- 

). 1 ,, tOPCvKKl-! n 

/IPf ; 1! L3H ' \ 

[I II 1 II . ' .11' 311 ■ ' 

I 1 I 3JKBH/H 

BonoMoraTsnbHafl nHcJjopMaiiw^ 
; v 

HanonHeHUfl, we K<wpyiOTCi3 a nepeflaiOTCJi 
;a;ihKO ovLpeci aebi-ibie ott^m*:-! :v:e.«py 
nooneflOBaTanbHUMn BHfleocwrHanaMH (win 
KaflpaMM) b to spewR, Korfla wcnonbsyscTcs 
6onee acficpeKTMBHbie MeKKaapoBbie KOfiepu, 
sahtriKJHaeToa b tom, mto olu^Skh nepeflann He 
Cif'pain'iMHtsaioTCfi qohmm eflUHCTeannbiM 
fieKOflnposanhibiM KaAPOM, a pacnpocTpaHfWTCs 
' < j i ,c b 

Macaxupo Ya.Aa 3 CTaTbe, oaarnaBneHHotf 
i 1 1 in c soccra / r 

3MAeondK9i i " u : b - - i ■ -s 

p o:.bbi5Kb<" iFFb j on Seiwo'ec; 
in Communications, v. 1 (1989), June, N 5, 
M \ -> n - k x -< i 
fpiw >sm l ] i i 

eAMHcraeHHoro Kawana (r e oahoto cnon) 
epeaa- 3 

■ VBf r pa pfiKOjj a iPBJiflp - no-eoio 

'v > ^ ^ . II . I n 

BOOOTaHaBTli-fBaeTOfl CnOOOSOM OOKpblTHS 
)! IH6;<M 33 CMS )f "I - " U 11, no 

9TOMV cnocoDv 6noi<n :/3 nonvneHboro 
npsflbiAyunero BUfleoiOApa 'SflanraiOTCis 
s9«Tcpavb 55/se-!:«: cpepfiero ni-iabeHMfi 
Sjnoi'OB pac gj . u >v o 3r 3 )v 

M L -L ' III' 

CnOOOS M0JK8T OKa3aTbOfl flOCraTOMHHM Ans 

OAi-ioro nnn , nponynieHHbix o.noKoa bo A" 1, 
^t- r^i Hv ■ v 1 r 1 \ 
DriOKOG Ob wckkst j m ' cepbe3bbi:< 

u- . 1 r i' r 1 'i ! 

wioryT bowth 4 onoKa, 11 KorAa any^aeTca 
norepa meihm & cxewe ATM. ana oSbNHO 
saTparnBaeT naKeTbi a'-ieeK, bosmo.^ihg, 3 naKera 
it 60.nbu.1e, b peaynbTare nonyqaeTCfl fleoflTK^s 
nponym,eHHbix 6riOK03. 


>Ke.nar6.nbH0 nioSb! Kanan oaas: ooiiep^a.n 
AaHHbie Ana ocHOBHoro niaotv 3 

aaSKHCtt MHCpopwai^kiePi, T3K0fi K8K AaHHbie 
CMHXpOHM33.LI,WM, i'„ CJieA0BaT8J1bH0, OH PfXUMH 

nepeAaBaibC!- npti nocronHHofl CNopocrvi 6*r m 
"rapaHrapoBaHHbiH" KaHari nocTOAHHoW 

OKOpOGTM OUT. 

Kanan paciJjnp©H««. Kowpya otjiivwwr 
it* v kc npyeat h 1 t-> t aj cm w 

BMfleOKaApOM, BOCCTaHOBJieHHbiM TOJlbKO H3 

icaHana Ssst.: {boropbib oype" rs.-^a bc;; ;:) :53Tbcq 
fiaHHbi© >aciifMp© 1 ~ flosoflx : hobho^ 
i b3o6b3Kebiib i :<obe'-inoro bpecytJMoro 

1- , >i r~\ v }^3 

out Mos(e: 6b!Tb nepeAan no 3 > VBR. 
t i ' * 1 - ^ 

3T0 be 33b:)0:-i6T pabj-eMb© ■ l lI t a 

KaapoB, a npHBSflST k B03Bpani,eHMio k iKwscrey 
ocboenorc ;;evK^Ma C.ny-:awna;3 tiorepui 

< ^ - v i " 
aa 1 iepe n 'i 

BbiroflHoe ncnanb30BaHM8 ce6ecronMooTn 

3 bb-:Ob - ' 

0::.bb:. .pObbp^pOibaH::,! I ;:ib:C0Abb;0c:3bt1P 

Bbpooci'-'bana ,pb!-b3,pbpcj;sab/:fi :<ab3.na 
paci;j/pebb>! A.n« nony-i6HMH n.a^Hbix 
pacui^pewuifi »;oM5i--ibnpoaabi'-;ii OasoBoro 
BMaeocxrHana k ashhwx pacuj^penufi flrw 
nony^ebHn KOHi-MHoro A'5KOAbpo3abbcro 
b^paobi-ima.na 

3Ta oxewa AsyxKaHarbHoro KoanpoBaHi/is 
6aim iipoBepena MOAejinpoB3>ineM Ha 
KGMPbtoTepe Ha AByxKananbHOM 

npwoi ct 36ne HM 1 3 

K3K 6b:j"io coo6u4eHO s iEEE J. on Seieoted 
Areas in Commun, v. 7. H 5, June, 1989 b 
03amaBnehiHoH 

BUfieOGMrHa.nOK 
rOBOpHTCfl 0 TOM, i-ITO 
\m flBUMOHMfl ATIR 


AHfl CX6M 


npHBOAi^i 


nepefiaiorefl 


h 1 b3 flBtUKQI-liilfl 

MacTb Kanana 6a3b! e 


- 1- - r i3s OKU 

i/< "t p ' ;30cc"-a : -:oEij':ebM;; ocuoBHoro 
pe>KMMa H3o6pa«eHWf!. TaK kbk KaHan 
pacLLinpeHun coAepiKMT rnaBHUM oSpasow 

j Ki- / • W 'p J«./ 

norepq pabbbix s*3 sroro nanana 

1 ■ 1 3(| ' 1 ■ A , > I , J 3 ^/ 

' H ( 1 3 ' [ ' 3J I 

■ . If ,H 5 

BMfleocwrHana flaHHbie KaHa.na 6a3bi 
npeflocraBHr flpnyoTHMoe xa^ecrBO 
i«c6pa.«:eHi'!fl .p.ns ^ermx oonacTePi, ho oo.nee 
Aeianbbbie o6n3CTm woryT HMeib atv^Moe 
i-'OKajKeHiie. becvoTp;! na to. nio soMribtoTepHoe 

b<o.aeji^poK3Hi-ie yKasuaaer, mto ara 
oneuwajibHafi cxewa na oohob© H.261 
ycTofiMMBa k noTepe a^efiKM n npn CKopocT.ax 
1-10 3Ta norepn HeaaMeTHa. 

HacTOfliAee ni3o6peTeHne wweeT i^enbio 
npeflnoi n ,(.c n < / 1 

AeKOA^poBaHns Bi^AeoowrHanoB, 
3aimflMpoBaHHbix noaa6nHt» AeyxKaHanbi-ibiM 
MeTOflOM, n, cor.naoHO nepsov 1 ? , ' 

afeK0A^pOB8HH« TaKtf X K0AHp0B3HHb)X 

BUfleoci-ifflanoB b rjooTBeTOTBMH c n. 1 cjpopwyjib! 
M3o6peTeHns xa - 11 ^fl tsm mto oh 

TarOKe BKnioHaeT 3Tanbi BbisBnenns, noTepsHbi 
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n, ecnn 3to mmsst m©cto, t-iHTepnonjiUMH 
norepBHHbix fiai i - k c AaHHbix 

paciuMpeHkiR HenocpeacTBSHHO 
npeAtijeci'Eiyioiiiero nony^eHHoro 
KCflnposaHHoro BMAeoonrHana v\ eeKTOpos 
norrvNei-iHbix m KaHana oaabi s 

ASHHblB MOMShT. 

A i " ) i n a tot- c{>ai 

KaHan 6a3bi nepeaaeTca no 

"rapan: ^pofiEiHHOMV 1 ' Kan3.r:y raw eaivihiw 

oSeoneHneas np^er asiwasoom sei-a- 

/ /IK hjfOB, 

riony-iei-ir-bix a piaHHbiii momsht. 3ih BeKT'OPbi 

! H ' Kt ! H '>1 J C ! i •.0(,6XOAK!r>1bl 

flnfi ooecneMe ' i ero >ABMra b 

r 111 JlH ,< l'V;.' O } " ' 1 

Cdl/P 11 /' f IHH V , 1[ , ] 

nonojibaoaaib ana MHrepnorumnn AaHHbix 

paoujMpeHMSi, noTepswHbix sis KaHana 

paouiHpeHMS Teiv-yniero KoawpoBaHHoro 

BMAeocwrHana. Cnooog b cocTseTOTBMH c 

ICTCPWWM ' ~< ' ■ ' TO 

1 t J L -t- 

raiMecTBO BoooTaHoaneHHoro M3o6pa>KSHH5i 
fia>K8 b ojiy-iae SonbLuorc Hwcna 6noK03, 
noTepflHHboc b KaHane pacwupeHwa, H3-aa 
riorepH naKSToe weaK. 

HHtepnoiq , i < ■.) n^H/ia imkt 
^ BbinonHSHa 3 o6.HEjCTy: r -peoPpasoEia!-::-"; n<: 

npeAUidCTByioiuMX nonyneHHax jmetfKax 
Mt-icpopMaijjiW KaHana paciunpeHMa o 
ncnonb»BaHH©M /MHeBHoro KOfinpo3aHx!fi 
(HanpMwep, TpaH3McropHoS* cxeMbi c 
n - - Y.^aKO 3 

o6mnx Meprax, aro Cyaer nenpiieMr.eMo na 
npa:;T;ii-e i i Kop^potiabbbie j ' 

paopJHpeHHfi KaflpOB M3MeHSK)TCfl 

npocTpanoTBei-iHO we>Kny KaapaMM h s'-isfiKH He 
coflep>KaT flaHHbix, OTHOcjstanxcn k oflHowiy w 
tomv >ks MSOTonono^eH^io, a ynncTHenbi b 
flocTynHOM npocrpaHCTBe meSta. 
CmopBarenbm. xmepnomnvm flOTOKHa 
ocymecTBiiaTbCfi b o6nac™ 3neweHTa 

I A b flOHO, MTO 

wsoSpeyeHKe b caiwoM luhpokqm acneiae ne 
orpaHUMMaaoTCH 3tkm n pear; o'-ui ra e m bi m 
cnooo6oM. 

fleKOflep ana aeKoa^poBaHHS KaHana Saau 
-•„••-- ,-M-f _ o ^ ibo Ka#pa 

Aiw 3anoMHHaH«« HenocpaAcreeHHO 

i oudHHoro KaHana 

II,,.-' Ill ! 

Ill , bah ' \ 111 

np» wnawpoBaHvm cneAyioiiinx, iexyuiy\x 
BiiAeocMTT-ianoB. noflxoAHinifPi cnoco6 
nojiy-ieHH;:: HPnocpefic: "senno npaAiiiecTSv'KjLuwx 

^ ihh w pa< i ' t < irisi 

3C o 5TO H30 - 1 i.9K.nK S3 

> janebinn oui/mh/ ms>hav' 3t>sm 
aanneam-ibiM 6a30BbiM CMrHanow h 
Henocp^cT: S e:-ibi:. npe^biJSO: ayioLjj,nM 

iflOfvl TO MO^ST 

DbiTb AOOTi^rHyTO nyieM aanHCbisaHHfi 
' 1 ^r<-iL J npaAiiJeoTByioiiiefo 
i ipoeaHHcro onrnana bo STopoe 
i ii j ^ i| i i i i 

BnocneflPTBHM ormmfr ms«ay stumh fiByiwa 

1 |. b t I! !>". I B^'i ' M •' O' \ 

AribTepHaTHSHO HsnocpeflCTBeHHO 
npeAW80TByioim« AeKOfliTposanHbie AaHHbie 
ii sawn crv'T 5b!~b - ;e,bb 3 

3anoMHH3!0 ties i 3 r reM, HTo6t.i 

ohh Mornn SbiTb i^cnojTb30BaHbi HanpfiMyio fina 


fieKOAnpoeaHHf! TeKymsro B^aeoawrnana no 
cnoooSy HacTOfltnero jooopeTeHMfi. 

Cnoco6, no3Bon«ioti(na o6napy;+cnTb ; 
nponyineHbi nn KaKne-jii^oo flaHHbie 
paouunpeHnq K3 KaHana pacLi.inpeni.13, b fleyanax 
Syaey saBkicerb or cxswbi KOA^poeaHHS. 
npHn-en^sMoP Kopepow t - i OCbi^HO 
i i _n oyA'?T nepe^asaTbCb b 

npOHyMepOBaUHblX H^eWKaX T3KI",' ;i,'(.W ! 

npn anajiHse nonyneHHoti nooneflOBaTenbHccyn 
ysqetsh mo i a b h'lix 

r ouTb pot <orAa 

j n I MH 

SU'Vtt l-'J " .V.JO !• i ,1 

na o;;ho3-5 < 1 ? i HenoapeK^ei-iHixX 
meeK, rpa /m ... > ■> 'v. T-ehKO/ uni.-i 

HHafiKaiMM. 33TBM 3T11 AaHHhie 

HHTepnon.v > < aosaHneM seKropoa 

flBM>KeHMSi n AaHHbix pacujupeHMfl M3 

3,r ; cT r i yrsyioLLierc 

KOfikipoBaHHoro Bkifleocn.-Ha.na. 

ComacHO fipyrowy acneKry ;«o5peTetwji. 
ASKOAep ana peannsaiiHH HacTGRiiero cnocooa 

1 1 Ej / 1 J I ^ I 

rhssSkm Ana cnpeaeneHH.fi. norepsHbi jih 
i i. > h I ? m / \ inana 

nonyMaHWt AaHHbix MHT«pnonai4n»!, 

BI<n:0'-:aiO!ilHX p 


iopaao-r 


3pa»,i/i 


ABHxeHHfl Kanana gaaw, no; 

IHI-lbl i )M6H H I ti I r D A ,J|'.; b 

n»6wx nponyujem-ibix pam-ibix paoiuHpeHna 

l1HTSpnonnpOBaHHblMM fiSHHoiMH 

CpaacTBO nHTapnonfli^kiM mcokbt BKniwaTb 
nepsoe aanownHaioLuee ycrpoi^oTBO Kaapa AH5? 

v ' ii r y->r ; o ." vn- h lr i 
Sasbi, KoropbiH npeacyaBnfley oo6ofi 
BoccTaHoanenxe <*» Kanana 6a3bi 
pep; S9bn npafiij.is i- i 

i i i ' ana i c joes 

sanowiiHaicmee votpo^ctbo Kaapa An« 
v i an 

MJXl II n l lo m 

no.nybeHMf! Aannax pacninpeHna nyreivi 
' - ! / l i r h 5noi< 

M -3 ( I fH PI I H 

13 OOOTEieTCTBllH f. TlOnyHeHMblMH i3eK:Op3Ml1 
flBMXeHMS 

A"bTepbaTHEHo nooneAHMe 
AeKOftiipoBanHbie aawnbie pactunpeHMS Moryr 
6bi"b aanwcaHbi b sanoMMHaioiAee yoipoHCTBo 
i<a;:ipa -;xv-» tlonee nosyyiero npuMeneHUH 
a.pcTBc tp non>?un/i. 
Koraa He Ha6nKwaioTca norepw weftm, 
posopep cpyaKpnoH^pyeT sai< ootibubia 
■ i . ;pbi B cnynae 

fl noTepM siHsiiK/i i-'HTepriOj^poBabHiae 

8 «cnoxib3yioTca bm6cto iiH$opiviaLi,nn e 
e - ;iHe/K3x c e"a. e j ra r - . , 
BMAeoctfrHana, tgm cawbiM yBennHMBaa 
) ■ LiiaiOLtyyio c 6no soOpa a 
Koropoe oh BHpaSaTbiBaeT, no cpaBHeHHio c 
naiiecTi-ibiiviM AeyxKaHaribHbiMH peKop,spa».ii.?. 

Venepb eyner onwcaH npspnoHTmeribbbiP 
sapwaHT ncnonnenHq nao6peTennfl TonbKO a 
Ka^ecrse npumepa ia oo-bfiOH8H npHHpi^n 

AtPLIOTB/'q 8 A6T3.TSSX CO OObinKoM Ha 

conpoBO>KAanjLnne pncyHKi-1, tab: 
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itw. 1 npeflCTaarifieT 6ji0K-cxeMy 
n3BecTHoro AByxKaHanbHoro ASKOfiepa, 

BblXOAHOpi CUTHajl KOTOpOrO MCWCeT 6blTb 

AeKOflnpoeaH o noMOiiibic cnoco6a n npaSopa 
HscroBniero n3o6peTSh^a; 

cpur. 2 fleMOHcrpkipyer cxewy AeKOAepa 

- ! 1 - r ■ - . > • 1 r ,", r, l , ; - ] , ■ , - f , ; r -, , , 

spur. 3 noKa3bisaeT nuarpaMwy 

CQBepiJjeHCTB0E!3HM« S/V C00TH0iii8HHB 

riocjieiioeareribHOCTii eMeocMrrianos, 
nanyneHHbix emopspot» 0nr. 2, cpaBHewHux c 
- eM /Ke aeK< „ ■ ji > /^jjhm 6e3 

I J 

cpoTorpacpwH, aeMOHCTpnpy>otmra ksn8ctbo 

stcofiwpoBahH . Dpa>K6H;i pin 
ciah-fiapi-riOM r!:..iCj-:ei;osai-=?.iibi-ior;Tii 
BMAeocurHaiiOB Ana nony^eHMJt peaynbTaroB 

C$3Hr O MM. j >. L ' ( hp 

1H3 J J h/- ^ U" < c 

[ :m>;h -i . > tctbsi-ihc 

HHrepnojiwpoaaHHbix flanHbix. 

06paTHMC*i cM3Maiia i< cpur. 1, rfie 

SlIfieOciirHf^Ob. 1 OW;0neb/bbe: 

KOTopopiy npPMappirpc.p ppopoo p npi^ioop 
HaoToaiiiero M3o6pere»Mfl a Koropwi? 5y«er 
r.rvr ■ , , ^ i ■ ^ ^ 

» , i nofiepa cjjwr. 1 
npeACTaBJiaer codg^ woawp^HpOBaHHoe 
i . /" : J| . • 1 — ' 

KOfl^poBaHMS CCrf'T H.261. MacTM. 
cooTBe]c:rBy!0!jine cxtw.n H 26'P pacrioi iKKebb 
b npefiejiax nymcrnpHoiS mm*. 


i SBSHTHSaTOpOM 1 


BMfleooMrHana. 
AwarpaMMbi hs; 

AMCKpSTHblS 
BbinOJlHHIOL14H8 c 

.aB.n.qsoiAnScfi or 


O-ffjjit.pbie oneiviepTb! 
;TGKymnB) ! BMfleocnrnan, 


ABi-liKbl- 


Hero BMASocMrHan, scccTaHoansHHbifi sia 

KOA-pjusabboro 3i-ip:ec':'!.-!fHa.na oa-pb nocne 
j,hh Ha nioSbie .qai-iHbie eenTope 

, - 1 ... s \ , :/; , t i ,- c 

noMOLUbio KOfla ah?! TSKymero 3Hfleoonmana 
3tot 
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(57) Abstract 

A decoder for decoding coded video signals comprising a base layer and an enhancement layer includes a cell loss detector 
(66) for detecting when cells are missing from the enhancement layer. In such an event the enhancement data from the immedi- 
ately previous video signal displaced by displacer (64) according to the current motion vectors provides interpolation data for the 
missing cells. The interpolation data is added to the decoded base layer as indicated by adder (52). The enhancement data is ob- 
tained by subtracting the immediately previous base video signal stored in frame store (50) from the immediately previous de- 
coded video signal stored in frame store (60) as indicated by subtracter (62). 
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METHOD AND APPARATUS FOR DECODING VIDEO SIGNALS 

This invention relates to a method of and apparatus 
for decoding a currently received one of a series of two- 
layer coded video signals each of which includes a base 
5 layer of coded base data and coded motion vector data, and 
an enhancement layer of coded enhancement data being the 
differences between the uncoded video signal and a 
reconstruction of the immediately previous base video 
signal from the base layer. 
10 In this application the phrase video signals refers to 

a digital representation of a video source. 

This so called two-layer coding of video signals was 
devised for use on ATM networks which may suffer cell loss 
causing large disruption in the transported data streams on 
15 variable bit rate (VBR) channels. 

An example of a two-layer coding scheme is disclosed 
in US patent number 4, 933, 762 in which transmission is via 
a main path and an auxiliary path of a variable rate 
digital transmission network. When the main path is not 
20 capable of dispatching the totality if the picture 
information, auxiliary information is dispatched via the 
auxiliary path. 

A drawback of conditional replenishment systems where 
only the significant differences between successive video 
25 signals (or frames) are coded and transmitted when more 
efficient interframe coders are used is that transmission 
errors are not confined to a single decoded frame but 
propagate into later frames. 

Masahiro Wada in an article titled "Selective Recovery 
30 of Video Packet Loss Using Error Concealment", IEEE Journal 
on Selected Areas in Communications, Vol 7 (1989) Junek no 
5, New York US describes an error concealment method for 
single channel (i. e. one layer) transmission cheme over a 
VBR channel. When a decoder detects a video packet loss, 
35 picture quality is partially recovered by motion- 
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compensated error concealment in which blocks fr6m the 
previously received video frame are shifted by the average 
motion vectors of the blocks which neighbour those used for 
concealment. This method may prove adequate for one or two 
5 missing blocks but may cause a greater disturbance for a 
larger group of missing blocks. Experiments by the 
Applicant have shown that as many as four blocks can be 
fitted into a cell, or packet, and when cell loss occurs on 
an ATM network, it usually happens in bursts of cells, 

10 perhaps betwwen three and tend, resulting in tens of 
missing blocks. 

Preferably, the base layer carries data for a base 
mode picture together with vital information such as 
synchronisation data and should, therefore, be transmitted 

15 at a constant bit rate on a "guaranteed" constant bit rate 
channel. 

The enhancement layer coding the differences between 
the video signal being coded and a video frame 
reconstructed from the base layer alone (which will also be 

20 referred to as "enhancement data"), brings the base mode 
picture up to the final required quality. The enhancement 
layer will, in general, have a fluctuating bit rate and can 
be transmitted via a VBR channel. Should any of this 
information be lost it will not affect tracking of the 

25 reconstructed frames but will only result in a momentary 
reversion to base mode quality. The occasional loss of 
resolution is compensated by obtaining the benefits of VBR 
transmission, for example, cost efficient use of the 
network channels. 

30 Such coded video signals can be decoded by decoding 

the base layer to obtain a base video signal, decoding the 
enhancement layer to obtain enhancement data, and combining 
the base video signal and the enhancement data to obtain 
the final decoded video signal. 

35 This two-layer coding scheme has been verified by 

computer simulation on a two-layer adaption of the CCITT 
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H. 261 standard as reported in the IEEE Journal on Selected 
Areas in Communications, Vol 7 No. 5 June 1989 in an 
article by M. Ghanbari titled "Two-layer Coding of Video 
Signals for VBR Networks" in which the inclusion* of motion 
5 compensation to code the video signal in the base layer 
leads to a high degree of bandwidth compression. The 
motion vectors are transmitted as part of the base layer in 
a "guaranteed" constant bit rate (CBR) channel as they are 
essential for reconstructing the base mode picture. As the 

10 enhancement layer mostly carries information about picture 
details or edges, the loss of data from this layer is seen 
as loss of resolution in the reconstructed picture 
generated from the decoded video signal. The base layer 
data will deliver an acceptable picture quality for plain 

15 areas but more detailed areas may suffer visible 
degradation, although computer simulations indicate this 
particular H. 261 based scheme is resilient to cell loss 
with rates as high as 1 in 10 not being readily visible. 

The present invention aims to provide improved 

20 decoding of video signals encoded by such two-layer 
techniques and, according to a first aspect, a method of 
decoding such coded video signals according to the preamble 
of claim 1 is characterised in that it further includes the 
steps of detecting whether any enhancement data is missing 

25 from the enhancement layer; and, in such a case, 
interpolating the missing enhancement data from the 
enhancement data of the immediately previously received 
coded video signal and the motion vectors of the currently 
received base layer. 

30 The invention utilises the fact that the base layer is 

transmitted via a "guaranteed" channel thereby ensuring 
receipt at the decoder of the motion vectors of the 
currently received, coded video signal. These motion 
vectors will therefore be available to provide the 

35 appropriate displacement to the immediately previous 
enhancement data to determine which of those enhancement 
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data should be used to interpolate -the enhancement data 
missing from the enhancement layer of current coded video 
signal. The method according to the present invention has 
the advantage that it provides a good quality reconstructed 
5 picture even with a large number of blocks missing in the 
enhancement layer caused by bursts of lost cells. 

The interpolation of the enhancement data could be 
carried out in the transform domain on the previously 
received enhancement layer cells of information when linear 

10 transform coding (eg. DCT coding) is employed. However 
this will not, in general, be practicable as the 
enhancement coded parts of the frames vary spatially 
between frames and the cells do not carry data related to 
the same location but are packed into the available cell 

15 space. The interpolation is, then, preferably carried out 
in the picture element (pel) domain but it should be 
understood that the invention in its broadest aspect is not 
restricted to this preferred method. 

The decoder for decoding the base layer may have a 

20 frame store for storing the immediately previous decoded 
base layer (the base video signal or base picture) to be 
used as a reference in decoding the following, current, 
video signal. A convenient method of obtaining the 
immediately previous enhancement data necessary for the 

25 present invention is to determine the differences between 
that stored base video signal and the immediately previous 
decoded video signal. This can be achieved by storing the 
immediately previous decoded video signal in a second frame 
store and subsequently obtaining the differences between 

30 these two video signals in known manner. 

Alternatively, the immediately previous decoded 
enhancement data itself could be stored in a frame store so 
as to be available directly for decoding the current video 
signal by the method of the present invention. 

35 The method adopted to detect whether any enhancement 

data is missing from the enhancement layer will depend in 
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its details on the coding scheme used by the video 'signal 
coder. Usually, the enhancement layer will be transmitted 
in numbered cells so by inspecting the received cell 
sequence one can determine which, if any, may have been 
5 lost. When one or more cells are found to be missing, the 
data that may have been lost can be determined from the 
information of the intact cells bounding the missing cell 
or cells. This data is then interpolated using the motion 
vectors and the enhancement data from the immediately 

10 previous coded video signal. 

According to a further aspect of the invention, a 
decoder for implementing the method according to the first 
aspect of the invention as recited in the preamble of claim 
5 is characterised in including a cell-loss detection means 

15 for detecting whether any enhancement data is missing from 
the enhancement layer; interpolating means for providing 
interpolation data comprising the enhancement data of the 
immediately previous received, coded video signal modified 
in accordance with the motion vectors of the currently 

20 received base layer; and means for replacing any missing 
enhancement data with interpolated data. 

The interpolating means may include a first frame 
store for storing a first base video signal which is a 
reconstruction from the base layer of the immediately 

25 previous coded video signal, a second frame store for 
storing the immediately previous decoded video signal, 
differencing means for obtaining the enhancement data by 
subtracting the first frame from the second frame, and 
displacement means for displacing the enhancement data in 

30 accordance with the received motion vectors. 

Alternatively, the last decoded enhancement data may 
be stored in a frame store for later use by the 
interpolating means. 

When there is no cell loss the decoder functions as 

3 5 previously known two-layer decoders. In the event of 
possible lost cells, the interpolated data is used instead 
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of the information in the missing cells to reconstruct the 
video signal thereby increasing the resolution of the 
picture generated by it in comparison to the prior art two- 
layer decoders. 

5 a preferred embodiment of the invention will now be 

described, by way of example only, and its principle of 
operation explained in more detail with reference to the 
accompanying drawings of which: 

Figure 1 is a schematic block diagram of a prior art, 
10 two-layer video decoder the output of which may be decoded 
by the method and apparatus of the present invention; 

Figure 2 is a schematic diagram of a decoder according 
to the present invention; 

Figure 3 is a graph of the S/N ratio improvement of a 
15 video sequence obtained by the decoder of Figure 2 compared 
to the same decoder operated without the use of 
interpolated data to replace missing enhancement data; and 
Figures 4a and 4b are copies of photographs showing 
the quality of the decoded picture of the same standard 
20 video sequence used to obtain the results of Figure 3 
suffering 10% cell loss from the enhancement layer 
without and with, respectively, use of interpolated data. 

Referring first to Figure 1, a schematic prior art 
video signal coder is shown which provides two-layer coding 
25 of the type to which the method and apparatus of present 
invention is applicable and which will now be described 
generally to aid understanding of the invention. The coder 
structure of Figure 1 is a modification to a coder 
implementing the CCITT H. 261 coding scheme. Those parts 
30 corresponding to the H. 261 scheme li. e. within the broken 
lines. 

Figure 1 shows the steps of coding a video signal. 
Separate elements of the diagram do not necessarily 
represent discrete physical devices carrying out the 
35 particular process step. 
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An incoming (current) video signal, being one of a 
series, is coupled to an input 1 and has subtracted from it 
a video signal reconstituted from the immediately previous 
coded base video signal after compensation for any motion 
5 vector data which will be coded along with the code for the 
current video signal. This reconstituted video signal is 
obtained from a frame store 2. The subtraction is 
represented by the subtracter 4. 

The resulting difference video signal, which is that 

10 to be coded for transmission, is transformed by a DCT 6 and 
subsequently quantised by a variable quantizer 8. The 
quantizer 8 is controlled to maintain an output buffer 10 
(which stores the quantized data along with other essential 
information multiplexed with the quantized data by 

15 multiplexer and VLC 12) with contents within preset upper 
and lower limits. 

The output from the buffer 10 constitutes the base 
layer output from which a base video signal can be 
reconstituted at a decoder in known manner and as will be 

20 described with reference to Figure 2. 

The base video signal is also reconstituted within the 
H. 261 type coder of Figure 1 by an inverse quantizer 12 and 
an inverse DCT 14. 

The reconstituted base video signal from the inverse 

25 DCT 14 for the immediately previous input video signal is 
compared to the current incoming video signal by a motion 
estimator 18 which determines the motion vectors 
for this current video signal. The reconstituted base 
video signal and is also added to the existing contents of 

3 0 frame store 2' as denoted by adder 16. 

The motion estimator 18 is also coupled to the 
multiplexer 12 which incorporates the motion vectors in the 
base layer for the video signal being coded and to frame 
store 2 so that the frame store' s 2 contents 

3 5 correspond to that obtained by a decoder decoding the base 
layer. 
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The differences between the current incoming' video 
signal and the video signal as would be reconstructed from 
the immediately previous base layer is derived by 
subtracting the latter from the former as is denoted by 
5 subtracter 20 which is shown coupled to the video signal 
input 1 and the adder 16. The difference signal is then 
quantized by a fine quantizer 22 and output via multiplexer 
24 as an enhancement layer at output 25. 

In one implementation of encoder the enhancement layer 
10 is obtained in the transform domain by subtracting the 
output of the inverse quantizer 12 from the output of DCT 
6 and coupling the difference to the fine quantizer and VLC 
22. 

The base layer is transmitted on a constant bit rate 

15 guaranteed channel which ensures a minimum picture quality 
is obtained by a receiving decoder. The enhancement layer 
may be transmitted on a variable bit rate VBR channel to 
improve the received picture quality when received and take 
advantage of VBR facilities. 

20 A known decoder for decoding the two-layer coded video 

signal provided by the coder of Figure 1 is shown 
schematically by part of Figure 2 which as with Figure 1, 
shows the process of decoding, individual elements not 
necessary corresponding to discrete physical items. The 

25 known decoder of Figure 2 comprises those processes 

outwith the dotted boxes. These decoding processes will be 
described first. Those elements inside the dotted box of 
Figure 2 comprise additional, exemplary, processes for 
carrying out the present invention and will described 

30 later. 

The decoder of Figure 2 outwith the dotted boxes 
operates as follows. A received base layer is coupled to 
a VLD and demultiplexer 40 via a buffer 42. The output of 
the demultiplexer 40 is converted to a video signal by 
35 inverse quantizer 44 and inverse DCT 46. This decoded base 
layer signal is used to obtain a base video signal in known 
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manner by adding it to the immediately previous base 1 video 
signal stored in a frame store 50 (modified as necessary by 
the motion vectors coupled to the frame store 50 from the 
demultiplexer 40) as indicated by adder 48. 
5 A received enhancement layer is converted to an 

enhancement video signal by VLD and demultiplexer 52, 
inverse quantizer 54, and inverse DCT 56. The output of the 
inverse DCT 56 is added (i.e. combined), as indicated by 
adder 52 (constituting combining means), to the base video 
10 signal to provide an enhanced video signal at the output 58 
of the decoder. 

If cells of enhancement data are lost from the 
enhancement layer because of bit rate limitations imposed 
by the VBR channel on which the enhancement data is 
15 transmitted, then those portions of the final video signal 
will simply be the base, i. e. unenhanced, video signal. 

The decoder of the present invention shown in the 
entire Figure 2 can provide some concealment of the lost 
cells as follows by the use of an interpolating means shown 
20 in the dotted boxes of Figure 2. 

The immediately previous video signal output by the 
decoder of Figure 2 is stored in a second frame store 60 
from which is subtracted, as indicated by a subtracter 
62, the base video signal reconstituted from the current 
25 base layer. This difference video signal is displaced by 
a displacer 64 according to the current motion vectors 
coupled to the displacer 64 from the demultiplexer 40. 

The incoming enhancement layer cells are monitored by 
a cell loss detector 66 (constituting cell loss detection 
30 means). If cell loss is detected enhancement data from the 
displaced, immediately previous enhancement layer stored in 
the displacer 64 is switched to the adder 52 by switch 68 
under the control of the cell loss detector 66 so that this 
data interpolates for the enhancement data lost from the 
3 5 current enhancement layer. 
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The cell loss detector 66 operates by inspecting the 
cell sequence numbers of the incoming enhancement layer 
cells. In this embodiment it is part of the VLD and 
demultiplexer 52 but is shown separate from it for clarity. 
5 Figure 3 shows the relative improvement in signal-to- 

noise ratio (S/N) using the cell concealment method of the 
present invention. The non-processed picture with a 10 per 
cent cell loss has an average S/N of 3 9 dB. The almost 
constant S/N is due to the variable bit rate coding of the 

10 second layer, which codes pictures at a constant 
quantization step size of 8 (dynamic range of original 
coefficients -2048 to 2047) in this embodiment of decoder. 
Finer quantization gives a better picture at the expense of 
more data in the base layer. 

15 Since the second layer data carry residual 

quantization noise of the base layer, their contribution to 
the measured value of S/N seems to be marginal. This is 
because the base layer S/N itself is relatively high. It 
has an average of almost 34 dB, which is variable due to 

20 the variation in the quantization step sizes. It should 
also be noted that not all the second layer cells carry 
large amplitude quantization distortions so their 
loss does not contribute a large value to S/N. However, 
their effect on the subjective quality of the pictures is 

25 much more pronounced. 

Figures 4a and 4b shows a part of picture in a 
sequence without and with cell concealment, respectively. 
Improvements to the tie and the left hand of the portrait 
obtained by the method and apparatus of the prevent 

30 invention can be seen in Figure 4b. The enhancement on the 
picture quality becomes more distinct when the processing 
is applied to an isolated blurred area of the picture. 
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1. A method of decoding a currently received one of a 
series of two-layer coded video signals each of which 
includes a base layer of coded base data and coded motion 

5 vector data, and an enhancement layer of coded enhancement 
data being the differences between the uncoded video signal 
and a reconstruction of the base layer, the method 
including the steps of: 

a) decoding the base layer to obtain a base video 
10 signal; 

b) decoding the enhancement layer to obtain 
enhancement data; and 

c) combining the base video signal and the 
enhancement data to obtain a decoded video signal; 

15 and characterised in that the method further includes the 
steps of: 

d) detecting whether any enhancement data is missing 
from the enhancement layer; and, in such a case 

e) interpolating the missing enhancement data from 
20 the enhancement data of the immediately previously received 

coded video signal and the motion vectors of the currently 
received base layer. 

2. A method as claimed in claim 1 in which the 
enhancement data of the immediately previous received, 

25 coded video signal are obtained by determining the 
differences between the immediately previous decoded video 
signal and a reference base video signal reconstructed from 
the base layer of the immediately previous received, coded 
video signal. 

30 3. A method as claimed in claim 2 in which the decoded 
video signal is stored in a frame store (60). 
4. A method as claimed in any preceding claim in which 
the detection of whether any enhancement data are missing 
from the enhancement layer is carried out by inspecting the 

35 received enhancement layer. 
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5. A decoder for decoding a curreatly received one of 
series of two-layer coded video signals each of which 
includes a base layer of coded base data and coded motion 
vector data, and an enhancement layer of coded enhancement 
5 data being the differences between the uncoded video signal 
and a reconstruction of the immediately previous base video 
signal, the decoder including: 

a) a first decoding means (40, 44, 46, 48, 50) for 
decoding the base layer to obtain a base video signal; 
10 b) a second decoding means (52, 54, 56) for decoding 

the enhancement layer to obtain enhancement data; 

c) combining means (52) for combining the base video 
signal and the enhancement data to obtain a decoded video 
signal: and characterised in that it includes 
25 d) a cell-loss detection means (66) for detecting 

whether any enhancement data is missing from the 
enhancement layer; 

e) interpolating means (50, 60, 62, 64) for 
providing interpolation data comprising the enhancement 

20 data of the immediately previous received, coded video 
signal modified in accordance with the motion vectors of 
the currently received base layer; and 

f) means (52, 68) for replacing any missing 
enhancement data with interpolated data. 

25 5. A decoder as claimed in claim 5 in which the 
interpolating means includes a first frame store (50) for 
storing a reference base video signal which is a 
reconstruction from the base layer of the immediately 
previous received coded video signal, a second frame store 

30 (60) for storing a second frame which is the immediately 
previous decoded video signal, differencing means (62) for 
obtaining the enhancement data by subtracting the reference 
base video signal from the immediately previous decoded 
video signal, and displacement means (64) for displacing 

35 the immediately previous enhancement data in accordance 
with the received motion vectors. 
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